feat: 5 CI features — lock files, matrix comments, commit status, nightly scans, trends#81
Merged
feat: 5 CI features — lock files, matrix comments, commit status, nightly scans, trends#81
Conversation
…htly scans, trends Add 5 interconnected CI features that transform Observatory from a CLI tool into CI infrastructure teams depend on: 1. **Lock files** (`mcp-observatory lock` / `lock verify`) — like package-lock.json for MCP. Snapshot server schemas, assert they haven't drifted in CI. 2. **Matrix PR comments** — multi-server scan results in one aggregated table with expandable details per failing server. 3. **Commit status checks** — green/red check mark on the PR commit SHA. Can be made a required check to block merges. 4. **Nightly scans with auto-issues** — `ci-report` command + workflow template. Scheduled scans that open GitHub issues when regressions are detected. 5. **Trend tracking** — run history stored in `.mcp-observatory/history.json`. Health trends shown in PR comments: "A (95) ↗ was B (82)". Also adds 15 new telemetry enrichment fields across all features to track adoption, ecosystem health, and server reliability metrics. - 15 new files, 13 modified files - 51 new tests (287 total, all passing) - Action updated: targets input, set-status input, matrix scan support Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
- Remove unused CheckResult import (commit-status.ts) - Remove unused defaultLockPath import (commands/lock.ts) - Remove unnecessary type assertion (lockfile.ts) - Fix Promise rejection type (ci-issue.ts) - Remove unused beforeEach import (ci-issue.test.ts) - Fix async function without await (ci-issue.test.ts) Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
🎉 This PR is included in version 0.20.0 🎉 The release is available on: Your semantic-release bot 📦🚀 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
5 interconnected CI features that transform Observatory from a CLI tool into CI infrastructure teams depend on:
mcp-observatory lock/lock verify. Like package-lock.json for MCP schemas. Snapshot, commit, verify in CI.ci-reportcommand + workflow template. Scheduled scans open GitHub issues on regressions..mcp-observatory/history.json. PR comments show:A (95) ↗ was B (82)Also adds 15 new telemetry enrichment fields across all features to track adoption, ecosystem health, and server reliability.
Stats
New CLI commands
New Action inputs
Telemetry data collected
lockFileExistslockDriftDetectedmatrixServerCountcommitStatusSetnightlyScanhistoryEntryCounttrendDirectionTest plan
npm run build— clean compilenpx vitest run— 287/287 tests pass (51 new)mcp-observatory lock→ creates lock.jsonmcp-observatory history --json→ shows entriesmcp-observatory ci-report --format json→ valid JSON🤖 Generated with Claude Code